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Abstract In this paper, we mainly study one class of convex mixed-integer non¬ 
linear programming problems (MINLPs) with non-differentiable data. By drop¬ 
ping the differentiability assumption, we substitute gradients with subgradients 
obtained from KKT conditions, and use the outer approximation method to re¬ 
formulate convex MINLP as one equivalent MILP master program. By solving a 
finite sequence of subproblems and relaxed MILP problems, we establish an outer 
approximation algorithm to find the optimal solution of this convex MINLP. The 
convergence of this algorithm is also presented. The work of this paper generalizes 
and extends the outer approximation method in the sense of dealing with convex 
MINLPs from differentiable case to non-differentiable one. 

Keywords Convex MINLP • outer approximation ■ decomposition • master 
program 
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1. Introduction 

Many practical optimization problems are modelled as mixed-integer nonlinear 
programming problems (MINLPs) involving continuous and discrete variables and 
the study of solution algorithms for these optimization problems has been an 
active focus of research over the past decades (cf. [3l fT0l[T^[T^fTilfT5lfT6l[^[2^[25] 
and references therein). Suppose /, Qi : K” x —>■ K {i = 1, ■ ■ ■ , m) are nonlinear 
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functions, X is a nonempty compact convex set in R." and y is a set of discrete 
variables in The general form for MINLPs is defined mathematically as follows: 


minimize 


(P)<^ 


y 

subject to 


9 iix,y) < 0,i = I,--- ,m, 

X G X,y £Y discrete variable. 


( 1 . 1 ) 


This paper is devoted to one class of convex MINLPs in which objective and 
constraint functions f,gi for i = 1, • • • ,m are convex but not differentiable. 

The class of convex MINLPs has been extensively studied by many authors and 
several methods for these MINLPs have been developed over past decades. These 
methods include branch-and-bound, generalized Benders decomposition, extended 
cutting-plane method, NLP/LP based branch and bound and outer approximation 
method (cf. [2l[5l[6l[71[^[^ [TTl[T^[T^IT9l[2^[^[^ and references therein). Note that 
the extended cutting-plane method was proposed by Westerlund and Pettersson 
|24| for solving differentiable convex MINLPs. Subsequently, Westerlund and Pet¬ 
tersson [25] presented this method to deal with a more general case of MINLPs 
including pseudo-convex functions. It was shown in |25| that one MINLP with 
pseudo-convex functions and pseudo-convex constraints can be solved to global op¬ 
timality by the cutting-plane techniques. In 2014, Eronen, Makela and Westerlund 
|6] generalized the extended cutting-plane method for solving convex nonsmooth 
MINLPs and provided one ECP algorithm which was proved to converge to one 
global optimum. Recently they [7] further considered this extended cutting plane 
method to deal with nonsmooth MINLPs with pseudo-convexity assumptions. 

It is known that Duran and Grossmann |5] introduced the outer approxima¬ 
tion method to deal with a particular class of MINLPs which was restricted to 
contain separable convex differentiable functions and not general convex differen¬ 
tiable functions in all variables. These separable convex functions were composed 
of convex differentiable functions in continuous variables and linear functions in 
discrete variables separately. Afterwards Fletcher and Leyffer |8| further extended 
the outer approximation method for solving convex MINLPs with convex and con¬ 
tinuously differentiable objective constraint functions, and provided a linear outer 
approximation algorithm to attain the optimal solution of this MINLP by solving 
a hnite sequence of relaxed subproblems. This extension is the pioneering work 
on outer approximation method in a sense of solving MINLPs where the discrete 
variables are considered as nonlinear. In 2008, Bonami et. al [2] also studied outer 
approximation algorithms for convex and continuously differentiable MINLPs. Re¬ 
cently the authors in |6] and [23] used the outer approximation method to study 
convex nonsmooth MINLPs and established the resulting algorithms. It is noted 
that differentiability of functions plays an important role in the construction of 
relaxation and is proved to be an important matter for allowing to solve these 
relaxed subproblems efficiently. Since nonsmooth optimization problems dehned 
by non-differentiable functions appear in practice, from the theoretical viewpoint 
as well as for applications, it is interesting and significant to consider convex and 
non-differentiable MINLPs. Motivated by this, in this paper, we are inspired by 
[2l[5l[6ll8ll23| to continue studying one convex MINLP by dropping the differen¬ 
tiability assumption and aim to construct an outer approximation algorithm for 
solving this MINLP. The outer approximation method used herein is along the line 
given in 01231 and consists of the use of KKT conditions to linearize the objective 
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and constraint fnnctions at different points for constructing an equivalent MILP 
relaxation of the problem. 

The paper is organized as follows. In section 2, we give some definitions and 
preliminaries used in this paper. Section 3 contains the equivalent reformulation 
of convex MINLP by the outer approximation method and one outer approxima¬ 
tion algorithm for finding optimal solutions of this MINLP. The reformulation are 
mainly dependent on KKT conditions and projection techniques. For the algo¬ 
rithm construction, it is necessary to solve a finite sequence of nonlinear programs 
including feasible and infeasible subproblems and the relaxations of mixed-integer 
linear master program. The convergence theorem for the established algorithm 
is also presented therein. The conclusion of this paper is presented in section 4. 
Section 5 is an Appendix which contains the proofs of the main results given for 
constructing the algorithm in the paper. 


2. Preliminaries 


Let II ' II be the norm of M" and denote the inner product between two elements of 
R" by (•, •). Let I? be a closed convex set of R" and x £ O. We denote T(f2, x) the 
contingent cone of fl at x', that is, v G T{f2,x) if and only if there exist a sequence 
{wfc} in R" converging to v and a sequence in (0, -|-oo) decreasing to 0 such that 
X + tkVk G O for all A: G N, where N denotes the set of all natural numbers. It is 
known from [l] that 

T{n,x) = c?(R+(f7 — x)) 

where cl denotes the closure. 

Let N{n,x) denote the normal cone of f? at x, that is 

^(17, a:) := {7 G R” : { 7 , 2 — ®) < 0 for all 2 ; G 17}. (2-1) 


It is easy to verify that normal cone N{n,x) and contingent cone T{n,x) are the 
polar dual; that is 

N{Q,x) = (T{n,x)')° := I 7 G R" : ( 7 ,w} < 0 for all v G T{Q,x)^. 

Readers are invited to consult the book [1] for more details on contingent cone 
and normal cone. 

Let ifi : R" ^ R be a continuous convex function, x G R” and h G R". Recall 
(cf. [2^) that d'^(p{x){h) denotes the directional derivative of 75 at x along the 
direction h and is defined by 




y(x -h th) - <fi(x) 
t—> 0 + t 


We denote 9ip(x) the subdifferential of ip at x which is defined by 


dip{x) := {a G R" : (a, x — x) < fp{x) — ip{x) for all x G R"}. 

Each vector in d(p{x) is called a subgradient of ip at x. It is known from |20| that 
a G dp{x) if and only if 


{a, h) < d"*~(p(x)(/i) for all h G R". 
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Recall that ip is said to be Gateaux differentiable at x if there exists dip{x) G K" 
such that 

<p{x + th) - ip{x) ^ /i g R" (2.2) 

t-s-0+ t 

and p is said to be Frechet differentiable at i if (p is Gateaux differentiable there 
and the limit in (12.211 exists uniformly for ||/i|| < 1 as t —^ 0"*“. 

It is known from [20] that p is Gateaux differentiable at x if and only if dp(x) 
is the singleton. Further, Gateaux differentiability of p is equivalent to the Frechet 
differentiability of p due to the local Lipschitzian property of p and the compact¬ 
ness of unit closed ball in M". 

Given a continuous convex function cj) '■ R" x —>■ M and {x, y) G M” x one 

vector (a, /3) G M" x is the subgradient of 4> at (a;, y) if and only if 

> <^(®, 17) + for all G M" x (2.3) 

where {a,P)'^ is the transpose of matrix {a,l3). When y is fixed {resp. x is fixed), 
the subdifferential of <j>{-,y) {resp. <j>{x, •)) at x {resp. y) is the set defined by 

d4i{-, y){x) := {a G M" : 4>{x, y) > 4‘{x, v) + {oi,x — x) for all x G H.”} 

(^resp. d(l){x,-){y) := {/3 G : (t){x,y) > (l){x,y) + {P,y-y) for all y G 

The following proposition on the subdifferential of convex functions is easy to 
verify from the definition. 

Proposition 2.1 Let (j) : K" x —>■ R 6e a continuous convex function and {x,y) G 
R" X RP. Then for any {a, j3) G d4){x, y), one has a G d4>{-, y){x) and fi G d(j){x, ■){y). 

It is an interesting question to consider the converse of Proposition 2.1. This 
question is also interesting even for smooth convex functions in mathematical 
analysis. The question is explicitly stated as follows: 

Given one continuous convex function 4> ■ R” x R^ —>■ R and one vector a from 
94'{'jy){x), whether or not is there some vector f) G R^ such that (a, /J) G d(j>{x,y) ? 

The following propositions provided an affirmative answer to this question. 
These propositions will play a key role in construction of outer approximation al¬ 
gorithm in the sequel. The first proposition is on convex and Frechet differentiable 
functions. 

Proposition 2.2 Let (f : R" x R^ —>■ R 6e a continuous convex function and {x, y) G 
R" X R^. Suppose that (f){-,y) is Frechet differentiable at x and 4>{x,-) is Frechet dif¬ 
ferentiable at y. Then (j) is Frechet differentiable at {x,y). 

Proof. By the Frechet differentiability of <(>(■, y) and (f){x, •), one has 

9<('(-,27)(®) = {Vx<(>(i,27)} and d(l>{x,-){y) = {Vy(l>{x,y)}. 

This and Proposition 2.1 imply that d<j){x,y) is the singleton and 

dcj>{x,y) = {{V x(l){x,y),V y(t>{x,y)}. 

Hence (f is Gateaux differentiable at {x, y) and consequently Frechet differentiable 
at {x,y). The proof is complete. □ 
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Proposition 2.2 may not necessarily be true for non-convex functions. Consider 
function on K x K defined as: 4>{x,y) = , ^ 2 \ 3/2 if ^ 0 and <j){x,y) = 0 

(a: -\-y 

if =0. Then (\> is continuous on M x K and partial derivatives Vx4>{Q, 0) and 

Vy(?i(0,0) exist (Va:(/i(0,0) = Vy(?i{0,0) = 0). However, one can verify that 4> is not 
differentiable at ( 0 , 0 ). 

Proposition 2.3 Let (j) '■ K" x —>■ K &e a continuous convex function and {x, y) £ 
K" X K^. Then for any a € y){x), there exists P £ such that (d, P) £ d(j)(x^ y). 

Proof. Let Fy : K" —>■ M" x be dehned by Fy{x) := {x,y). Then <!>{■, y) = po Fy, 

and it is easy to verify that Fy is differentiable at x and 

VFy{x){h) = (/i,0) £ M” X (2.4) 

holds for all h £ K”. Let a £ d4>{-, y){x). We first prove that 

a £ VFy{x)*{d(t>{x,y)) (2.5) 

where VFy{x)* is the conjugate operator of VFy{x). 

Since p is continuous at [x, y ), it follows that dp{x, y) is a nonempty, convex 
and compact subset by [Ml Proposition 1.11] and then VFy{x)* (dp{x, y)) is convex 
and compact as VFy{x)* is continuous. 

Suppose to the contrary that d ^ VFy{x)*{dp{x,y)). By the seperation theo¬ 
rem, there exists u £ K" with ||w|| = 1 such that 

(d,M) > max{(VPy(x)*(a,/3),w) : {a,p) £ dp{x,y)} 

= max{((Q,,0), VFy{x){u)) : {a,P) £ dp{x,y)}. 

This and ( 1 ^ imply that 

(d, u) > max{{(a, P), (h, 0)) : (a, /3) £ dp{x, y)}. (2.6) 

Noting that d £ dp{-,y){x) and p is a continuous convex function on K" x K.^, it 
follows from |20l Proposition 2.24] and (12.61) that 

d'^<l>{-,y){x){u) > (d,w) > d'^p{x,y){u,0) = d+<)>(-,y)(®)(h), 

which is contradiction. Thus (EM) holds. 

By virtue of (12.511 . there exists {a,P) £ dp{x,y) such that d = S/Fy{x)*{a,P). 
It suffices to prove that d = d. 

For any /i £ M”, by using EM, one has 

(d,/i) = {VFy{x)*{d,P),h) = {{d,P),VFy{x){h)) = {{a, p), {h,0)) = {d,h). 

This means that d = d. The proof is complete. □ 

The following proposition is on the subdifferential of maximum function of two 
convex functions which is from [261 Theorem 2.4.18]. This result will be used later 
in our analysis. 

Proposition 2.4 Let : K” ^ K fee a convex and continuous function. Define 
y}j^{x) := max{(p(a:),0} for all x £ M”. Then is a convex continuous function 
and 

d(p+{x) = [0,l]d(p{x) (2.7) 

holds for all x £ M" with ifi{x) = 0 , where [ 0 , l]dip{x) := {ty : fe £ [ 0 , 1 ] and 7 £ dip{x)} 
for any x £ M”. 
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3. Main Results 

In this section, we mainly study convex MINLP problem of (HU) by dropping the 
differentiability assumption and aim to establish one outer approximation algo¬ 
rithm for solving such problem. 

Let convex MINLP be defined as (HU) and set 5 := ( 51 , • • • ,5m). For the case 
that f,gi{i = I,-- - ,m) in (11.11) are convex and smooth, it is known from [2l[6l|8] 
that main idea of outer approximation algorithm for convex smooth MINLPs is 
using linearization of the objective function and the constraints at different points 
to build a mixed-integer linear program (MILP) relaxation of the problem; that 
is, given some set K with optimal solutions of several optimization problems, it is 
possible to build a relaxation of problem (P) in (11.11) : 

minimize 0 

subject to ] <9, 

^}x-x\ (3.1) 

g{xj,yj) + Vg{xj,Vjf < 0 , 

X £ X,y £Y discrete variable. 

When dealing with problem (P) in (11.11) . the concept of subgradient is the 
substitute of the gradient in relaxation of (P). Note that arbitrary subgradients 
substituting gradients in (EH) is not sufficient to equivalently reformulate problem 
(P) (see Example 3.1 below). As in [3l[6], with the help of KKT conditions, we 
obtain several special subgradients, which we then use to reformulate problem (P) 
as one equivalent MILP master program such as EH- 

3 . 1 . An overview of the method. For the equivalent reformulation of problem 
(P) in (11.11) and by using techniques in (13.IL we appeal to the concept of projection 
for expressing problem (P) onto y variables. For any fixed y £Y, we consider the 
following subproblem P^\ 

{ minimize f{x, y) 

subject to g{x,y) < 0, (3-2) 

a; e A. 

If there exists some x £ X such that g{x,y) < 0, the subproblem is said to be 
feasible; otherwise, P^ is said to be infeasible. 

For the validness of KKT conditions, we assume that the following Slater con¬ 
straint qualification holds: 

Assumption (Al) For any y £Y satisfying that the subproblem P^ is feasible, the 
following Slater constraint qualification holds: 

(Slater CQ) g{x,y) < 0 for some x £ X. 

Let 

E ■.= {y £Y : g{x,y) < 0 for some x £ X} (3.3) 

denote the set of all discrete variables y that produce feasible subproblems. Then 
the projection of problem (P) onto variable y can be given as follows: 

{ minimize f{x,yj) 

subject to g{x,yj)<0, (3-4) 

X £ X. 




Convex MINLP and Outer Approximation Algorithm 


7 


Now let uj e X' be fixed. Since X is compact and /, gi are continuous, it follows 
that the optimal solution to subproblem exists. Thus we can suppose that 
Xj is one optimal solution to By the assumption (Al) and KKT conditions, 
there exist ■ • ■ , such that 

' 0 € df(-,gj)(xj) + Aj^^dgi(-,yj)(xj) + N(X,Xj), 

iGl(xj) 

. ^J'l >0, 2 = 1, - • ■ ,m, 


where 

I{xj) ■.= {ie {!,■■■ ,m}\ gi{xj,yj) = 0} (3.6) 

is the active constraint set. This means that we can take aj € df{-,yj){xj) and 
G dgi(-,y^)(xj)(i =!,■■■ ,m) such that 

Oj ^ ^ G A(A, rTj). (^■^) 

iel{xj) 


By Proposition 2.3, there exist dj G and gj i € = 1, ■ ■ • ,m) such that 

{aj,Pj) € df{xj,yj) and e dgi{xj,yj),yi € {I, ■ ■ ■ ,m}. (3.8) 

Set := (Cj,i, ■ • ■ , ^j,m) and gj := {gj^i, • ■ • , gj,m)- We consider the following linear 
problem: 


LP{xj,yj) 


minimize 

X 

subject to 


g{xj,yj) + {ij,gjV < 0 . 

xeX. 


(3.9) 


The following theorem establishes the equivalence between subproblem P"^^ 
and linear program LP{xj,yj) of (13.91) . The proof of this theorem will be given in 
Section 5. 

Theorem 3.1 Let LP{xj,yj) be defined as (13.911 . Then Xj is one optimal solution for 
LP{xj,yj) in (13.91) and f{xj,yj) is the optimal value of LP{xj,yj) in (13.911 . 

We denote 

T := {j : py^ is feasible and Xj is an optimal solution to |. (3.10) 

Let j G T. By assumption (Al), we can take (Aj^,-- - G M+, {aj,/3j) G 

df{xj,yj) and gj^i) G dgfixj^yj) (i = 1, ■ • • , m) such that (13.711 holds. Applying 
Proposition 2.3, there exist fij G and gj^i G (i = I,-- - ,m) such that (13.811 
holds. Then we set 


''' jCj.m) and gj :— {gj^i^ ■ ■ ■ ^Vj,m)' 
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We consider the following MILP: 

minimize 6 

X, y, e 


{Ms)< 


subject to 


j < 0 Vj G T, 

g{xj, yj) + <0 Vj G T, 

X € X,y € E discrete variable. 


(3.11) 


By virtue of Theorem 3.1, we obtain the following theorem on the equivalence 
of problem (P) of (11.111 and MILP (M^) of (13.1111 . 

Theorem 3.2 Assmue that MINLP problem (P) of (ini) satisfies assumption (Al). 
Then MILP {M^) of (13.111) are equivalent to problem (P) in the sense that both have 
the same optimal value and that the optimal solution {x,y) to problem (P) corresponds 
to the optimal solution {x,y,8) to (M^) of (13.111) with 8 = f{x,y). 

For completely reformulating the problem (P), it remains to provide an appro¬ 
priate representation of constraint y G Y\E by supporting hyperplanes. Along the 
lines in Pl8]. we are inspired to study infeasible subproblems so as to eliminate 
those discrete variables that give rise to infeasibility. 

Let yi G Y\E. Then subproblem P^‘ is infeasible; that is, 


flx G X satisfying gfix, yi) < 0 for all i = 1, • • • , m. 


Let Ji be one subset of {1, • • • ,m} such that there is some x € X satisfying 


gi{x,yi)<0, 'ii&Ji- 


(3.12) 


Denote J;"'" := {1, ■ • ■ ,m}\Ji the complement of J/. To detect the infeasibility, we 
study the following subproblem : 


minimize 

X 


pvi 


subject to 


gi{x,yi) <0 Vie Ji, 

X e X, 


(3.13) 


where [g{x,yi)]+ := max{g{x,yi),0}. 

Since X is compact and g^ for i = 1, • • • ,m are continuous, then the optimal 
solution to subproblem F*'' exists. Thus we can assume that xi is one optimal 
solution to subproblem . For convenience to state the process, we divide the 
set y into three disjoint subsets which are denoted by JI , jf and jf. These three 
subsets are defined as 

( Jl := {i G y : g,{xuyi) = 0}, 

I Jf ■={ieJt ■■g^{xl,yl)>Q}, (3.14) 

[ jf ■■= {i G jf- : gt{xi,yi) < 0}. 

This means that jf~ = jf U jf U jf and by using continuity of one has 


d[gi{-,yi)\ + {xi) = dgi{-,yi){xi), Viejf and d[gi{-,yi)] + {xi) = {0}, Viejf. 
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By (13.121) and KKT condition, there exist Ajy € M+ for all i € Ji such that 

OG J2 d[gi{-,yi)] + {xi) + + N{X,xi), 

=0, ^i&Ju (3.15) 

, Aiy >0, Vi e Ji- 

Denote A; ^ = 1 for all i € Jf and A/ j = 0 for all i € jf . Using Proposition 2.4, 
there exist ^ £ [0, l](Vi € J}) and j £ dgi{-,yi){xi){'ii £ U J/) such that 

- ^ h,^il,^(^N{X,Xl). (3.16) 

By virtue of Proposition 2.3, there exist ^ such that (Ci,i,>7i,i) G dgi{xi,y{) 
for all i £ Jj^ U Ji . 

Since subproblem P^’- is infeasible, then there exists one optimal solution xi 
to subproblem F^’- such that Ylii^jx[gi{xi,yi)\+ > 0, by the continuity of gi and 
compactness of X. This gives the following theorem on subproblem . The proof 
is also given in Section 5. 

Theorem 3.3 The discrete variable yi £ Y\E is infeasible to the following constraint: 


9z{xi,yi) + {^l,i,gi,i)'^ < 0 , Vi£jj^UJi, 

X £ X,y £Y. 


(3.17) 


It is necessary to ensure that discrete variables that produce infeasible sub¬ 
problems are also infeasible in the reformulated master program. We denote 

5 := {Z : is infeasible and xi solves P^'}. (3.18) 

For any I £ S, take Xi^i > 0 and ^ £ dgi{-,yi){xi){i = 1, • • • ,m) such that (13.161) 
holds. Take gi^i £ such that (Cz,*,%,*) G dgi{xi,yi) for any i £ {I,-- - ,m} by 
Proposition 2.3. We set := (Cz,i,-" ,?z.m) and gi := {gri,--- , 91 ,m)- Then by 
using Theorem 3.3, we have the following theorem which shows how to eliminate 
those discrete variables giving rise to infeasible subproblems. 

Theorem 3.4 For any I £ S, let (Cz,»7z) be defined as above. Then the following con¬ 
straints 

+ yi€S, 

[x£X,y£Y 

exclude all discrete variables yi £Y for which subproblem P^^ is infeasible. 

It is known from Theorem 3.4 that we can add linearization from P*^' when 
subproblem P^‘ is infeasible so as to correctly represent the constraints y £ E in 
(IQ) . This gives rise to the MILP master program (MP) which is equivalent to 
MINLP problem (P) in (11.11) and used to reformulate problem (P). 

Let T and S be defined as (13.1011 and (I3.18L respectively. For any j £ T, 
by assumption (Al), we can take Xj^ >0 {i = I,-- - ,rn), aj £ df{-,yj){xj) and 
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^j,i £ 9gi{-,yj){xj){i = 1, ■ • • ,m) such that (13.71) holds, and by Proposition 2.3, we 
take Pj G K*’ and rjj^i G = 1, • ■ • , m) such that (13.811 holds. We set 

O-ud T]j . 

For any Z G 5, we take Xi^i > 0 and G dgi{-, yi){xi){i = 1, • • • , m) snch that (13.161) 
holds and by Proposition 2.3, we take rji i G snch that G dgi{xi,yi). 

Set 

■= ■■ and Vi ■= {Vi,ir ■ ■ 

The MILP master problem (MP) is given as follows: 


minimize 6 

X, y, e 


subject to 


(MP) < 


fixj, yj) + -7jJ ^ 

g{xj,yj) + (Cj ,Vjf (7y-7^ - ° ^ 

g{xi,yi) + < 0 VZ G S', 

\y -Vi J 

X € X,y £ Y discrete variable. 


(3.20) 


The following theorem, immediate from Theorems 3.3 and 3.4, is one main 
result in the procednre of reformnlating MINLP problem (P) of (11.11) as the eqniv- 
alent MILP master program (MP). 

Theorem 3.5 Assume that MINLP problem (P) of (11.11) satisfies assumptions (Al). 
Then master program (MP) of (13.201) is equivalent to problem (P) in the sense that both 
problems have the same optimal value and that the optimal solution {x, y) to problem 
(P) corresponds to the optimal solution {x,y,6) to (MP) of (13.201) with d = f{x,y). 

Remark 3.1. Theorem 3.5 is one extension of main resnlts given in [^I23| . and it 
generalizes the outer approximation method in the sense of equivalently reformu¬ 
lating convex MINLP problem (P) from differentiable case to the non-differentiable 
one. Further, it is known from Theorem 3.5 that all optimal solutions of problem 
(P) are optimal solutions to master program (MP). However, the converse is not 
necessarily true since some optimal solutions of (MP) may be infeasible to problem 
(P). We refer the reader to [2l Example 1] and |231 Remark 3.1] for the detail. 


Theorem 3.5 shows that some subgradients obtained from the KKT conditions 
enable to reformulate MINLP problem (P) as an equivalent MILP master program 
by outer approximation method. However, this procedure is not valid if arbitrary 
subgradients are chosen to replace gradients. The following example demonstrates 
that the substitution of the gradient by an arbitrary subgradient in the outer ap¬ 
proximation method is insufficient for the equivalent reformulation. 


Example 3.1. We consider the following convex MINLP problem: 

' minimize f{x, y) := x y 

X, V 

subject to 5 i(a:, y) := max{—a; -\-y + l,x — y-\-I}<Q, 
g 2 {x,y) ■■=x-y<G, 
a;G [0,2], yG {1,2,3}. 




(3.21) 
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One can verify that this convex MINLP in (13.2111 is infeasible. However, let the 
initial point j/o = 1- Then snbproblem P'^° is infeasible and we can consider the 
following subproblem F^°: 

{ minimize [gi{x,yo)]+ = gi{x,yo) 

X 

subject to g 2 (.x,yo) < 0, (3.22) 

xe [0,2]. 

It is easy to verify that *0 = 1 is the optimal solution to subproblem F^° and 

[-1,1] X [-1,1] C 951 ( 0 : 0 , yo)- 

Now, if we take (^ 0 , 1 ,50, 1 ) = (1,1) G dgi{xo,yo), (^ 0 , 2 , 50 , 2 ) = Vg 2 {xo,yo) and 
(ao,/3o) = Vf(xo,yo), then the MILP LF(xo,yo) is dehned as 

minimize 6 
X, y, e 

subject to X + y < 9, 

' x + y-l<0, (3.23) 

xefo,2],’ye {1,2,3}. 

The optimal solution to MILP in (13.2311 is {x,y,9) = (0,1,1). This means that the 
outer approximation method for this MINLP may generate an inhnite loop between 
points (a:o, yo) and (0,1). Thus the outer approximation method is invalid for this 
MINLP problem in (13.211) . Further, when tracking down why this method is not 
valid here, the reason noticed is that the KKT conditions at {xo,yo) for (^o,i,5o,i) 
does not hold; that is, 

/a(Ao,i, Ao, 2 ) G K+ satisfying Vf{xo, yo) + Ao,i(Co,i, Vo.i) + >^o, 2 ^g 2 {xo, yo) = 0. 

3.2. The algorithm. In this subsection, based on the solution of MILP master 
program (MP) in (13.201) . we pay main attention to one outer approximation algo¬ 
rithm for finding the optimal solution of problem (P) in (11.11) along the line in [5l 


At iteration k, the sets T and S in master program (MP) of (13.201) are substi¬ 
tuted by the sets and respectively which are defined as 


:= {j < k : F^^ is feasible and Xj solves F'^^}, 
:= {I < k : py’- is infeasible and xi solves F^‘}. 


(3.24) 


li k G then Xk solves and there exist {otk,Pk) G K" x and (Cfe,i,5fc,i) G 
K” X for all i = 1, ■ • ■ , m such that 


-afc - E G N{X, Xk) for some {Xk,i ■■■ , \k,m) G K+, 

2=1 

{oik,Pk) G df{xk,yk), 

. {ik,t,Vk,i) G dgi{xk,yk), Vi = 1, • • • ,m. 


(3.25) 


li k G then Xk solves and there exist (^fey, Vk,i) G K” xK^ for all i = 1, • ■ • , m 
such that 

{ m 

^k,i^k,i G iV(A, Xk) for some (A/j, 1 ■ ■ ■ , Xk^m) G M_j_ , 

i=l 

(Cfe.*,5fc,i) G dgi{xk,yk), Vi = 1, • • • ,m. 


(3.26) 
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Set 

' ' ■ ! ^k.rn) ‘Hid Tjj^ . , Vk.Tn')- 

To prevent discrete variable assignment yj (for any j £ T^) from being the solution 
to the relaxed master program, it is necessary to define UBD^ := min{f{xj,yj) : 
j £ T^} and add a constraint 9 < UBD^ to the master program. This gives rise to 
the following relaxed master program MP^: 


minimize 9 

X, y, e 

subject to 0 < UBD^ 

f{xj,yj) + <9 Vj £ T^ 

9 {xj,yj) + {£,3,93)^ (y-2) “ ° ^ 

9(^i,yi) + (£i,mf <0 v^£ 5 ^ 

\y-yij 

X G X,y £ Y discrete variable. 


(3.27) 


The new discrete variable assignment yk+i can be obtain by solving and the 

whole process is repeated iteratively until the relaxed master program is infeasible. 

We are now in a position to state the outer approximation algorithm for solving 
problem (P) in detail. 


Algorithm 1 (Outer Approximation Algorithm) 

1: Initialization. Given an initial yo G Y, set T® = := 0, UBD^ := 00 and let fc := 1 

2: for fc = 1, 2, ■ ■■ , do 

3: Solve subproblem 

4: if is feasible then 

5: Choose one solution Xfc of P^'^ 

Choose (ak,Pk) and := Vk ■= ,Vk,m.) as in 113.2511 

Set T'' := U {fc}, S'' := S'^-^ and UBD'^ := min{UBD'^-^, f{xk,yk)} 

6: else 

7: Solve subproblem and choose one solution of 

Choose ik ■= i£k,l,- ■ ■ ,£k,m), Vk ■■= {Vk,l,- ■ ■ ,Vk,m) as in 113.2611 
Set := U {fc}, := T''"! and UBD'^ := UBD*=-^ 

8: end if 

9: Solve the relaxation MP^ and obtain a new discrete variable yk+i 

Set fc := fc + 1 and go back to line 3 
10: end for 


Under the assumption of finite cardinality of discrete variable subset Y, the 
following theorem shows Algorithm 1 can detect feasibility or infeasibility of prob¬ 
lem (P) in (11.111 and the procedure in Algorithm 1 terminates after a finite steps. 
The proof is also given in Section 5. 

Theorem 3.6 Suppose that MINLP problem (P) in (11.111 satisfies assumption (Al) 
and the cardinality ofY is finite. Then either problem (P) is infeasible or Algorithm 1 
terminates in a finite number steps at an optimal value of problem (P). 
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4. Conclusions 

This paper is mainly devoted to the study of one convex MINLP in which ob¬ 
jective and constraint functions are continuous and non-differentiable. With no 
differentiability assumption, subgradients of objective and constraint functions, 
the substitute of gradients in convex and smooth MINLP, are chosen from the 
KKT conditions and used to reformulate the MINLP problem as one equivalent 
mixed-integer linear program. A counterexample shows that the chosen subgradi¬ 
ents, if not satisfying KKT conditions, may be invalid for the MILP reformulation, 
which demonstrates the necessity of KKT conditions in the equivalent reformu¬ 
lation. By solving a finite sequence of subproblems and relaxed MILP problems, 
one outer approximation algorithm for this convex MINLP is presented to find 
the optimal solution of the problem. The finite convergence of the algorithm is 
also proved. The work of this paper is the extension of references [5l[8ll23| and 
also generalizes outer approximation method in the sense of dealing with convex 
MINLP from differentiable case to the non-differentiable one. 


5. Appendix: proofs of Theorems 3.1, 3.3 and 3.6 

In this section, we present the proofs of several key results in Section 3. 

Proof of Theorem 3.1. To prove Theorem 3.1, it suffices to show that 

>0, V® € X with g{xj,yj) + < 0. (5.1) 

Let X € X he such that 

0 *^^ < 0 

and let I{xj) be defined as (13.611 . Then 

{^j,i,x - Xj) € I{xj). (5.2) 

By using (13.71) . there exists 7 G N(X,Xj) such that 

Oj + + 7 = 0- (5-3) 

ze/(xj) 

Noting that X is convex, it follows that x — Xj G T{X,Xj). This together with (15.211 
and (lOll implies that 

r = {aj,x-Xj) =-(^ Xj4j,i+-f,x-Xj^ >0. 

Hence dSH) holds. The proof is complete. □ 

Proof of Theorem 3.3. Since X is compact and g is continuous, then one has 

Y \.9i{xi^yi)\+ > 0 - 

i&Jf 


(5.4) 
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Suppose to the contrary that there exists x £ X such that {x,yi) is feasible to 
the constraint of (l3Tfl) . Then 

gz{xi,yi) + - xi) <0, \/i£Ji^UJi. (5.5) 

Noting that x — xi £ T{X,xi) by the convexity of X, it follows from (13.161) that 
there exists 7 £ N{X,xi) such that 

^ A,,,Cm+7 = 0, (5.6) 

where A;y = 1 for all i £ jf and A; ^ = 0 for all i £ jf . By multiplying (15.51) by A;y 
for any i G J/ U jf U jf , it follows from (15.611 that 

0> ^ h,igi{xuyi) + (^ ^ Aj_,Ci,i+7M - ®/) 

> X! = X] [gr{^UVl)] + 

ieJf ieJj^ 

as X — xi £ T{X,xi) and \iygi{xi,yi) = 0(Vi G Ji), which contradicts (15.41) . The 
proof is complete. □ 

Proof of Theorem 3.6. (This is similar to the proof for |231 Theorem 4.1]. For 
the sake of completeness, we provide the proof in brief.) 

For the proof of Theorem 4.1, we hrst prove that there is no discrete variable 
in Y generated more than once by Algorithm 1. Granting this, it follows from 
the finite cardinality of Y that the termination of Algorithm 1 holds after a finite 
number steps. 

At iteration fc, let (i, y, 0) be an optimal solution to the relaxed master program 
MP^. By virtue of Theorem 3.4, one can verify that y ^ yi for all I £ . Suppose 

to the contrary that y = yj^, for some jk G . Then {x,yji,,0) solves the relaxed 
master program MP^ and 

' §<UBD^ <f{x^„y^,), 

, Q (5 7) 

gi^jk . yjk) + i^jk . vjk V ^ < 0 . 

By using dsn) in the proof of Theorem 3.1, one has 

f >0. 

This and (EH) imply that f{xj^.,yj^) < 0, which contradicts 6 < f{xjj^,yj^) in 
([ 53 . Hence y i=- yj for all j G T^. This means that y is distinct from any yj for all 
j G U S^. 

Now suppose that the relaxed master program MP^ is infeasible for some 
k. Then Algorithm 1 terminate at fe-th step. Let p denote the optimal value of 
MINLP problem (P). If there is some j £ such that f{xj,yj) = p, then 

the conclusion holds. Next, we assume that f{xj,yj) > p for all j £ . Then 
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UBD^-^ > p and (otherwise, k C , UBD^ = UBD^-^ by Algorithm 

1 and consequently MP^ is feasible, a contradiction). Thus subproblem is 
feasible and /(x/e,?/^) > p. 

Suppose to the contrary that > p. If < UBD^~^, then p < 

f{xk,yk) = UBD^ and MP^ is feasible, a contradiction. If f{xk,yk) > UBD^~^ 
then p < UBD^~^ = UBD^ and thus MP^ is feasible, a contradiction. This means 
f{xk,yk) — P- The proof is complete. □ 
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